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INTRODUCTION 


Under  contract  to  the  Array's  Night  Vision  and  Electro-Optics  Laboratory, 
Westinghouse  has  been  Investigating  the  design,  test,  and  Implementation  of  a 
set  of  algorithms  to  perform  Intelligent  tracking  and  Intelligent  target  homing 
on  FUR  and  TV  Imagery.  Research  has  been  initiated  for  the  development  of  an 
Intelligent  target  tracking  and  homing  system  which  will  combine  target  cueing, 
target  signature  prediction,  and  target  tracking  techniques  for  near  zero 
break  lock  performance.  The  Intelligent  tracker  will  monitor  the  entire  field 
of  view,  detect  and  classify  targets,  perform  multiple  target  tracking,  and 
predict  changes  In  target  signature  prior  to  the  target's  entry  Into  an  obscur¬ 
ation.  The  intelligent  tracking  and  homing  system  will  also  perform  target 
prioritization  and  critical  almpoint  selection.  Through  the  use  of  VLSI/VHSI 
techniques,  the  Intelligent  tracker  (with  Inherent  target  cuer)  can  be  applied 
to  the  fully  autonomous  munition. 

During  the  fourth  quarter,  several  meetings  and  a  number  of  phone  conver¬ 
sations  took  place  between  Westinghouse  personnel  and  Cpt.  Relscher  of  NV&EOL. 

A  system  concept  was  developed  for  Intelligent  homing  and  almpoint  selection. 

The  problem  was  divided  into  long  range  homing  and  almpoint  selection  and 
close-in  homing  and  almpoint  selection.  Sets  of  875  line  FUR  Imagery  were 
extracted  from  the  NV&EOL  data  base  and  examples  were  presented  for  both 
categories.  The  subjects  of  close-in  homing  and  almpoint  selection  were  further 
divided  into  c  ose-ln  segmentation,  close-in  target  tracking  and  tracking  during 
the  transition  from  long  range  to  close-in. 

Westinghouse  personnel  participating  in  this  effort  Include  Thomas  Willett, 
Program  Manager,  Dr.  John  Romanskl,  John  Shipley,  Leo  Kossa,  Bill  Pleasance, 
and  Richard  Kroupa.  Program  review  and  consultation  is  provided  by 
Drs.  Glenn  Tisdale  and  Azriel  Rosenfeld. 
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1.0  SYSTEM  CONCEPT 


The  purpose  of  this  section  Is  to  describe  the  preliminary  Intelligent 
tracker  concept  that  has  evolved  during  the  course  of  this  work.  The  desired 
Intelligent  tracker  functions  are: 

1.  acquisition  and  track  Initiation  -  detect,  locate,  classify 

and  prioritize  targets  automatically  and  handoff  to  the  Internal 
tracker  (the  Intel llgnet  tracker  concept  Is  assumed  to  Include 
both  acquisition  and  tracking); 

2.  handle  multiple  targets  -  track  a  number  of  targets  In  a  scene 
simultaneously; 

3.  target  signature  prediction  -  predict  or  anticipate  target  obscuration 
and  how  the  target  signature  will  change  as  a  result  of  the 
obscuration; 

4.  reacquisition  -  reacquire  a  target  at  the  earliest  opportunity  following 
track  break  lock,  Including  departure  from  the  field  of  view; 

5.  almpolnt  selection  -  determine  the  critical  almpolnt  of  a  target 
which  may  be  an  interior  point  within  its  silhouette. 

A  video  timing  diagram  Is  shown  in  Figure  1-1.  Figure  1-2  shows  how  an 
image  appears  In  the  frame  store  device.  A  block  diagram  of  the  system  concept 
is  shown  in  Figure  1-3. 

The  heavy  vortical  lines  in  Figure  1-1  represent  the  cued  frames  and  the 
lighter  vertical  lines  are  the  tracked  frames.  Frame  1  Is  a  cueing  frame,  and 
frames  2,  3,  4,  and  5  are  tracking  frames  and  then  the  cycle  repeats.  Frame  6 
is  a  cueing  frame,  and  frames  7,  8,  9,  and  10  are  tracking  frames.  Thus  the 
complex  target  cueing  function  Is  performed  at  0.2  the  rate  of  the  simpler  tracking 
function.  Figure  1-2  represents  the  Image  in  the  framo  store  which  Is  divided  Into 
five  horizontal  and  addressable  strips.  This  Is  done  so  that,  Instead  of  waiting 
for  the  entire  frame  to  be  cued 
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Figure  1-2.  Image  In  Frame  Store  RAM 


Figure  1-3.  System  Block  Diagram 
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before  handover  to  a  tracker,  targets  can  be  handed  over  more  rapidly.  The 
reduction  In  handover  lag  Increases  the  confidence  that  both  cuer  and  tracker 
are  working  on  the  same  target,  and  reduces  the  size  of  the  track  window.  The 
frame  store  RAM  Is  organized  Into  five  Independently  addressable  strips  to 
aid  In  sending  the  gray  levels  surrounding  the  target  to  the  tracker  for  a 
reference  Image  and  to  decrease  the  access  time.  It  should  be  pointed  out 
that  the  five  tracked  frames  per  cued  frame  and  five  strips  for  frame  storage 
are  approximate  numbers  serving  as  a  straw  man  concept.  The  point  of  this 
discussion  Is  that  the  cuer  results,  labelled  CR,  In  Figure  1-1  can  be  ob¬ 
tained  between  the  first  and  second  frames  Instead  of  the  fifth  and  sixth 
frames  in  cne  video  stream. 

Referring  to  Figure  1-3,  we  descrlDe  the  Intelligent  tracker  functions 
previously  listed: 

1.1  TARGET  ACQUISITION  AND  HANDOVER 

A  horizontal  strip  of  a  frame  Is  snatched  In  real  time  and  placed  In 
a  frame  store.  The  cuer  processes  the  strip  and  detects  and  classifies  all 
targets.  That  part  of  the  frame  store  holding  each  target  and  Its  surrounding 
gray  scale  window  Is  sent  to  the  tracker  as  a  reference  Image.  The  tracker 
converts  this  to  a  binary  reference  image  and  now  tracks  this  target  from 
the  video  stream  until  the  next  cued  frame.  The  cuer  tells  the  tracker  where 
the  target  Is  within  the  frame  so  the  tracker  can  tell  the  write  control 
when  to  write  the  next  target  window  (now  from  the  video  stream)  and  sub¬ 
sequent  windows  Into  its  reference  image. 

1.2  MULTIPLE  TARGET  TRACKING 

There  Is  a  reference  Image  RAM  reserved  for  each  target.  Only  one 
tracker  is  required,  since  It  is  fast  enough  to  be  multiplexed  <.mong  targets. 
The  tracker  Is  a  bandpass  binary  correlation  tracker  In  this  preliminary  de¬ 
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sign  and  the  bandpass  Is  adjusted  at  the  cueing  rate  by  the  cuer.  Addition¬ 
ally,  the  tracker  forms  a  smoothed  track  for  each  target  In  second  order 
difference  equations  (to  Interface  with  the  rate  loop  In  the  sensor  glmbal). 

This  allows  reacquisition  of  a  target  which  has  left  the  field  of  view  but 
can  be  brought  back  into  view  by  moving  the  sensor  along  the  image  centered 
target  track. 

At  this  point  one  can  picture  simultaneous  multitarget  cueing  and 
tracking.  The  cued  targets  have  been  classified  and  are  ordered  in  an  Inter¬ 
nal  table  In  terms  of  priority.  The  priority  precedence  has  been  determined 
before  the  mission  and  loaded  In  the  cuer. 

1.3  TARGET  SIGNATURE  PREDICTION 

To  predict  obscurations,  a  histogram  of  the  background  ahead  of 
the  target  Is  analyzed.  The  track  window  errors,  which  are  used  to  form  the 
smoothed  track  for  reacquisition,  are  also  used  to  determine  the  position  of 
the  histogram  window  In  front  of  the  target.  From  the  histogram,  we  can 
compare  the  gray  levels  ahead  of  the  target  with  those  of  the  target.  If 
the  same  gray  levels  are  present  In  both,  a  clean  target  segmentation  Is  un¬ 
likely.  The  track  point  position  Is  adjusted  within  the  track  reference 
window  so  that  the  tracker  Is  using  that  portion  of  the  target  which  will  be 
obscured  last  (e.g.  the  rear  of  a  target  passing  behind  some  low  lying  shrubs). 
The  background  histogram  Is  also  analyzed  for  a  polarity  reversal  between 
the  target  and  the  background.  An  example  of  this  Is  a  case  where  the  tar¬ 
get  Is  moving  from  a  dark  background  into  one  lighter  than  itself  and  hence 
becomes  a  dark  target  against  a  light  background.  Under  this  condition,  the 
new  background  Is  segmented  and  binary  change  detection  at  the  background 
level  is  used  along  with  direct  segmentation  to  detect  the  target.  Having 
found  the  front  edge  of  the  target,  the  track  point  In  the  reference  Is  adjusted 
to  the  front  or  emerging  edge. 


1.4  REACQUISITION 

The  reacquisition  function  comes  Into  play  when  track  breaklock  occurs. 

It  Is  handled  by  a  combination  of  cueing,  histogram  analysis,  and  change 
detection.  A  difficult  problem  here  Is  the  reappearance  of  a  target  which 
Is  partially  obscured.  Segmentation  of  the  entire  shape  Is  not  possible  which 
prevents  automatic  target  recognition.  In  this  case  scene  change  detection 
provides  one  of  the  few  cues  of  target  reemergence.  histogram  analysis  of 
any  changed  areas  found  adds  useful  Information  because.  In  some  cases,  the 
target  histogram  will  exhibit  a  peakedness  not  found  In  a  background  object  such 
as  a  woods  clearing.  That  Is,  the  histogram  vtlll  resemble  a  Gaussian  rather 
than  a  Uniform  Distribution.  Otherwise,  the  clearing  may  be  mistaken  for  a 
partially  occluded  target. 

1.5  AIMPOINT  SELECTION 

This  Is  the  topic  for  this  quarterly  and  the  next  one;  It  Involves 
performing  almpolnt  selection  on  both  the  exterior  and  Interior  of  a  target. 


2.0  WEAPON  ANALYSIS 


To  properly  attack  the  Intelligent  tracking  and  homing  problem,  It  Is 
necessary  to  consider  the  entire  weapon  system  Including  the  sensor.  The 
design  of  an  efficient  weapon  system  can  be  aided  by  use  of  operations  analysis 
and  system  design.  Operations  analysis  examines  the  existing  and  projected 
personnel  and  material  to  estimate  the  cost  of  the  business  of  war.  Key 
determinations  are  the  Initial  and  recurring  costs  of  maintaining  weapons  and 
troops  In  readiness,  and  the  exchange  rates  expected  between  clashing  units  of 
force.  A  war  of  attrition  Is  anticipated  which  will  Involve  quantities  of 
material  large  enough  for  statistical  averages  to  be  meaningful.  Operations 
analysis  will  quantify  the  need  for  a  new  weapon  capability  by  specifying  such 
things  as  the  maximum  cost  per  round  of  munition  as  a  function  of  the  probability 
of  kill  per  round.  System  design  starts  with  the  weapon  system  requirements  thus 
provided  and  produces  specifications  for  subsystems  to  efficiently  meet  the  re¬ 
quirements.  The  subsystems  are  dealt  with  In  terms  of  parameters  which  primarily 
determine  performance  and  cost.  The  primary  objective,  the  most  efficient 
system  design.  Is  obtained  by  making  tradeoffs  between  subsystems. 

It  Is  not  within  the  scope  of  this  contract  to  design  a  weapon  system. 

We  are  limited  to  consideration  of  the  narrow  Issue  of  analyzing  the  Intelligent 
tracking  and  homing  problem  within  the  confines  of  an  existing  weapon  system, 
e.g.  the  Copperhead  Missile.  The  following  paragraphs  of  this  section  list 
parameters  that  affect  mission  success,  Including  the  assumptions  used  In  obtaining 
them?  describe  the  Copperhead  weapon?  present  an  example  to  Indicate  sensor  require 
ments?  and  analyze  the  advantages  of  a  body  fixed  system  and  a  glmballed  sensor 
system. 
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2.1  MISSION  REQUIREMENTS 


Some  aspects  of  the  operation  of  an  intelligent  tracking  and  homing  system, 
which  impacts  both  effectiveness  and  cost,  are  outlined  here.  These  include  foot¬ 
print,  target  Discrimination,  Impact  CEP,  and  countermeasures. 

Footprint  -  The  largest  dimension  to  which  the  footprint  can  be  related  Is 
the  kill  range  of  the  projectile.  A  maneuver  capability  this  large  would  obviate 
the  need  to  aim  the  projectile  at  launch.  Since  the  aiming  capability  already 
exists,  a  footprint  as  large  as  the  range  will  not  be  considered  further. 

The  next  largest  relevant  dimension  is  the  uncertainty  in  location  of  the 
targets.  In  an  assumed  five  minute  lag  between  reconnaissance  and  strike,  a  tank 
can  travel  a  maximum  of  4  km,  assuming  a  top  speed  of  30  miles/hour.  A  group  of 
tanks  might  achieve  a  maximum  travel  of  2  km  in  five  minutes  while  making  accept¬ 
able  average  progress  toward  their  objective.  Therefore,  strikes  against  isolated 
groups  of  targets  might  benefit  by  a  footprint  2  km  wide.  However,  an  important 
application  of  the  weapon  is  defense  against  a  massive  attack.  In  this  case,  the 
spacing  between  groups  might  be  only  a  fraction  of  a  kilometer,  and  the  requirement 
to  intercept  a  particular  group  of  targets  does  hold. 

A  still  lower  relevant  dimension  is  the  0.3  km  CEP  ballistic  dispersion. 

A  0.5  km  wide  footprint  would  have  a  0.5  probability  of  hitting  a  single  target  at 
the  ballistic  aimpoint.  The  lowest  dimensions  significant  to  the  footprint  are 
the  approxiamtely  0.4  km  group  size  and  0.1  km  spacing  of  targets  within  a 
group. *  Because  of  this  spacing,  a  footprint  somewhat  smaller  than  0.6  km  would 
probably  still  retain  a  high  probability  of  reaching  a  target. 

There  might  be  justification  for  a  footprint  as  low  as  0.1  km  spacing, 
even  though  this  would  reduce  the  probability  of  reaching  a  target.  A  maneuver 
footprint  considerably  smaller  than  the  ballistic  dispersion  would  serve  to 
disperse  multiple  rounds  over  multiple  targets.  If  the  cost  of  this  limited 
capability  is  sufficiently  low,  it  would  compensate  for  the  greater  number  of 

rounds  required  per  kill.  It  is  assumed  that  a  footprint  of  0.6  km  is  effective. 
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Target  Discrimination  -  In  order  to  home  on  a  specific  target,  It  must 
be  distinguished  from  other  objects  in  the  field  of  view.  The  effectiveness 
of  the  weapon  will  depend  on  the  accuracy  of  the  discrimination  function. 

Several  levels  of  discrimination  will  be  considered. 

1.  Object  detection  -  If  the  weapon  is  able  to  avoid  open  areas  and 
hit  an  object  about  the  size  of  a  target,  performance  might  be  sufficiently 
effective  provided  the  FOV  is  initialized  correctly  and  provided  few  non-target 
objects  of  similar  size,  such  as  trees,  are  in  the  area. 

2.  Discrimination  between  man-made  and  natural  objects  -  if  a  high 
probability  of  distinguishing  man-made  objects  is  provided  by  detecting 
straight  edges  and  right  angles, for  instance,  effectiveness  would  be  increased. 

3.  Discrimination  of  vehicles  vs  other  man-made  objects  -  detection 
of  wheels  or  motion  would  contribute  to  this. 

4.  Discrimination  between  tanks  and  other  vehicles  -  discrimination  of 
the  highest  value  targets  would  allow  the  most  expensive  weapon  to  be  used. 

5.  Discrimination  between  active  and  destroyed  vehicles  -  this  capability 
would  allow  the  weapon  to  avoid  a  target  already  killed. 

6.  Target  clusters  -  effectiveness  against  merged  targets  might  also 
be  achieved  by  the  following  means.  Multiple  hits  on  the  same  target  could 
be  avoided  if  each  weapon  is  assigned  an  individual  target  within  the  field 
of  view  and/or  within  a  group  of  targets.  The  assignment  could  be  made  by 
labelling  the  targets  relative  to  a  set  of  two-dimensional  coordinates,  such 
as  sensor  azimuth  and  elevation  or  the  major  and  minor  axis  of  the  target 
distribution.  This  would  not  be  as  effective  as  discrimination  against 
destroyed  targets. 
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Impact  CEP-  The  circular  error  probability  of  impact  relative  to  a 
desired  aimpolnt  has  a  maximum  limit  of  approximately  1.5  m  which  is  necessary  in 
order  to  attain  a  sufficiently  high  probability  of  kill  of  armored  vehicles  by 
available  warheads.  A  CEP  less  than  this,  but  greater  than  about  0.5  m  might  permit 
use  of  a  less  destructive  warhead  and/or  shallower  Impact  angles.  A  reduction  of 
CEP  below  this  lower  value  is  not  likely  to  Increase  effectiveness  much  unless 
a  value  on  the  order  to  centimeters  should  be  attained,  because  such  things  as 
viewing  ports  and  gun  muzzle  might  be  move  vulnerable.  A  1.0  m  CEP  is  assumed 
necessary  for  the  warhead. 

Countermeasures  -  The  weapon  cost  must  be  low. relative  not  only  to  the 
target  but  also  to  any  equipment  which  reduces  its  effectiveness.  Effectiveness 
must  be  maintained  in  spite  of  enen\y  tactics  encountered  during  an  attack.  One 
tactic  which  would  counter  an  IR  guided  weapon  would  be  to  launch  an  attack 
in  low  visibility  weather.  An  intermediate  condition  would  be  a  low  cloud 
ceiling  with  good  visibility.  A  shallow  trajectory  would  counter  this  restriction 
to  operation,  but  would  probably  require  more  comprehensive  image  processing. 

2.2  DESIGN  CONSTRAINTS 

In  the  absence  of  complete  information  about  existing  guided  missiles 
and  tanks,  the  following  list  of  parameters,  (some  of  which  represent 
Copperhead)  was  assembled  from  unclassified  sources  and  assumptions  based  on 
requirements. 
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WEAPON 


Length 

137  cm 

Di ameter 

15.5  cm 

Weight 

64  kg 

Range  (ballistic) 

3  -  20  km 

(gliding) 

8  -  20  km 

Speed 

500  m/sec. 

Ballistic  Dispersion 

300  m 

Maximum  Maneuver 

3  g 

Roll  Rate 

5-18  revs/sec. 

Autopilot  Time  Constant 

0.1/sec. 

Guidance 

proportional 

Glmbal  Limits 

±45  deg 

Maximum  Aperture 

12  cm 

Warhead  Capability 

top  and  side  armor 

Maximum  Impact  Angle 

TANK 

±45  deg 

Length 

6.6  m 

Width 

3.3  m 

Height 

2.4  m 

Maximum  Speed 

49  km/ hour 

Equipment  • 

Smoke  Generator 

Removable  Snorkle 

Night  Vision 

Deployment 

10  per  0.3  to  0.5  km  column 

In  addition,  it  is  assumed  that  a  1.0  m  CEP  of  impact  relative  to  an  aimpoint 
is  required  for  acceptable  effectiveness. 
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2.3  SYSTEM  DESIGN  CONSIDERATIONS 

A  complete  system  design  for  a  new  guided  weapon  would  be  most  efficient 
If  all  subsystems  were  considered.  However,  in  the  present  study  we  will 
consider  only  the  design  of  the  sensor- tracker  and  assume  that  the  airframe, 
warhead,  and  autopilot  are  specified.  The  Copperhead  projectile  will  be  used 
for  this  purpose.  An  objective  of  the  study  will  be  to  minimize  the  demand  on 
the  sensor-tracker  by  using  the  capabilities  of  the  remaining  subsystems  to  the 
greatest  extent  possible.  In  particular,  the  use  of  the  maximum  maneuver 
capability  c,  the  airframe  will  allow  the  shortest  possible  detection  range 
and  hence  the  lowest  sensor  resolution.  The  following  example  indicates  the 
considerations  Involved.  A  possible  geometrical  relationship  in  a  target  area 

is  shown  in  Figure  2-1. 
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Figure  2-1.  Assumed  Target  Area 


A  performance  parameter  of  major  importance  which  must  be  assumed  at  this 
time  Is  the  size  of  the  maneuver  footprint  required  of  the  weapon.  A  maneuver 
radius  equal  to  300  m  ballistic  CEP  will  be  assumed.  For  the  expected  target 
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spacing,  this  radius  would  provide  a  high  probability  that  each  projectile 
would  reach  a  target  If  the  ballistic  almpolnt  Is  the  center  of  a  cluster  of 
targets.  For  a  8.5  km  minimum  turn  radius  and  0.5  km  of  trajectory  required 
for  guidance  settling,  a  turn  must  be  Initiated  as  far  as  2.7  km  from  the  target. 
At  this  range,  detection  of  a  target  must  have  occurred.  If  six  resolution 
elements  are  required  across  a  2.4  m  target  to  achieve  detection,  an  angular 
resolution  of  2.4/6(2700)  =  0.15  mrad.  Is  required.  The  necessary  optical 
aperture  is  at  least  9.0  cm  at  10y.  The  angle  subtended  by  the  300m  maneuver 
radius  at  the  turn  Initiation  point  is  7  degrees.  This  means  that  a  field  of 
view  of  0.24  radians  would  be  required  to  encompass  the  maneuver  footprint. 

With  one  pixel  per  resolution  element,  an  Image  of  610  pixels  on  a  side  would 
be  required. 

To  be  consistent  with  the  maximum  maneuver  assumption  of  3  g's  (page  2-5), 
we  stipulate  that  the  platform  must  turn  cowards  detected  targets  at  a  range 

of  2.7  km.  Target  classification  and  prioritization,  requiring  10  lines  on 

the  target,  occurs  at  a  range  of  1.6  km.  These  maximum  maneuver  relationships 

are  summarized  in  Figure  2-2.  This  estimate  assumes  a  negligible  blind  range. 

% 

This  is  reasonable  since  the  target  will  fill  the  field  of  view  at  a  range  of 
about  27m. 
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Figure  2-2.  Homing  Events  vs.  Distance 
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2.4  BODY  FIXED  VS  GIMBALED  SENSOR 

Although  the  simplicity  of  a  body  fixed  sensor  might  contribute  more  to 
reduced  cost  and  Increased  reliability  than  a  gimbaled  sensor  for  a  small  homing 
weapon,  the  particular  homing  technique  is  a  major  consideration.  Figure  2-3 
shows  three  possible  Implementations  of  homing  guidance.  They  have  In  common  a 
simplicity  of  control  signal  processing  which  rotates  the  missile  body  until  a 
directly  measured  sensor  quantity  is  nulled.  The  first  implementation,  pursuit, 
nulls  the  angle  between  the  measured  target  position,  wit.h*“  field  q£  view, 
and  the  missile  longitudinal  axis.  The  second,  closing,  nulls  the  angle 
between  the  missile  velocity  vector  and  the  measured  target  position  within 
the  field  of  view  (line  of  sight).  The  third,  proportional,  nulls  the  line 
of  sight  (LOS)  angle  rate  relative  to  an  inertial,  non-rotating,  reference. 

The  angle  between  the  measured  target  position,  within  the  field  of  view, 
and  some  reference  is  called  the  line  of  sight  (LOS)  angle.  In  the  pursuit 
case,  the  LOS  angle  Is  relative  to  the  missile  longitudinal  axis;  In  the  closing 
case,  the  LOS  angle  is  relative  to  the  missile  velocity  vector;  in  the 
proportional  case,  the  LOS  angle  is  relative  to  an  inertial  reference.  The 
first  two  systems  are  position  controllers,  while  the  third  is  a  rate  controller. 
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Figure  2-3.  Homing  Strategies 
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Pursuit  guidance,  shown  at  the  left  of  Figure  2-3,  Is  the  simplest;  the 
output  of  the  sensor  Is  connected  to  the  control  loop.  However,  a  problem 
arises  with  pursuit  guidance;  as  the  body  Is  rotated  to  null  the  LOS  angle 
relative  to  the  longitudinal  axis,  the  missile  velocity  vector  Is  lagging 
behind.  Figure  2-3  shows  the  missile  pointed  at  the  target  but  the  missile  Is 
still  moving  along  Its  velocity  vector,  VM*  In  general,  changes  In  the  velocity 
vector  will  lag  changes  In  the  line  of  sight  angle.  Acceptable  miss  distance 
Is  possible  only  with  low  target  crossing  velocities  and  practically  no 
acceleration.  Even  with  a  fixed  target,  unintended  missile  acceleration  must 
be  minimized.  Gravitational  acceleration  might  be  avoided  by  a  terminal 
trajectory  that  is  very  close  to  vertical.  Otherwise,  It  must  be  compensated 
by  reference  to  a  vertical  gyro  for  instance.  Another  source  of  acceleration 
which  might  limit  accuracy  is  th-  y.'adient  of  wind  speed  with  altitude. 

The  targets  of  interest  are  expected  to  have  accelerations  of  about  0.2g  when 
following  curved  roads.  Therefore,  a  more  effective  control  must  be  implemented. 

The  second  of  the  three  guidance  methods  appears  most  effective  for  a 
fixed  sensor.  Although  lacking  a  standard  designation.  It  Is  referred  to  as 
closing  guidance  for  the  sake  of  discussion.  This  is  mechanized  in  some  bomb 
laser  kits.  The  velocity  reference  is  obtained  by  putting  the  sensor  in  a  wind 
vane  pod  ahead  of  the  bomb.  If  such  a  pivoted  device  is  not  practical  for  a 
projectile,  alternate  techniques  could  be  used  to  provide  the  velocity  reference. 
Closing  guidance  Is  less  demanding  on  the  imaging  sensor  for  a  fixed  sensor 
configuration  than  proportional  guidance.  Closing  guidance  is  more  demanding 
for  a  fixed  sensor  configuration  than  a  gimbaled  sensor  configuration.  In 
order  to  accommodate  the  missile  body  motion,  a  wider  field  of  view  and 
accorate  LOS  must  be  provided  for  closing  guidance. 
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Proportional  guidance  Is  quite  effective  and  Is  employed  In  most  homing 
weapons.  By  nulling  the  rate  of  the  LOS  to  a  constant  velocity  target,  the 
missile  travels  to  the  Intercept  point  In  a  straight  line.  The  miss  distance 
from  an  accelerating  target  can  approach  zero.  A  glmbaled  seeker  for  pro¬ 
portional  guidance  need  not  measure  angle  and  can  have  sizeable  bias  and  scale 
factor  errors  for  rate  measurement.  Proportional  guidance  places  the  highest 
demands  on  a  body  fixed  sensor.  A  body  fixed  sensor  must  provide  successive 
angle  measurements  from  which  the  LOS  rate  relative  to  the  body  Is  computed. 

The  body  rate,  which  has  several  times  the  magnitude  of  the  LOS  rate,  must 
be  measured  gyroscoplcally  (star  tracker  Is  Impractical)  and  added  to  obtain 
the  LOS  rate.  This  mechanization  requires  the  seeker  to  make  angle  measurements 
with  high  accuracy  and  low  noise  at  a  high  sample  rate. 

In  summary,  we  have  described  three  homing  methods  and  the  Inclusion  of 
body  fixed  and  glmbaled  sensors.  Pursuit  guidance  is  the  simplest  to 
implement  with  a  body  fixed  sensor  but  It  has  difficulty  with  accelerating 
targets  and  crossing  targets.  Closing  guidance  is  more  effective  than 
pursuit  guidance  but  It  places  more  demands  on  the  body  fixed  sensor  for  a 
wider  field  of  view  and  more  accurate  angle  measurements.  Closing  guidance 
appears  to  be  a  logical  first  choice  for  application  of  the  second  generation 
FLIR's  to  homing  applications.  For  conventional  FLIRS,  proportional  guidance, 
with  glmbaled  sensors,  is  still  the  favored  appraoch.  A  major  problem  in 
using  proportional  guidance  with  a  body  fixed  sensor  is  that  of  obtaining 
target  position  relative  to  the  missile  velocity  vector,  so  that  lead  angles 
can  be  developed. 


3.0  INTELLIGENT  HOMING 


There  are  a  number  of  Issues  and  related  work  which  must  be  addressed 
In  the  development  of  Intelligent  homing  beofre  we  proceed  with  the  processing 
of  images  from  the  NV&EOL  data  set.  Section  2.0  was  developed  to  provide  a 
systems  scenario  for  these  Issues. 

3. 1  RELATED  WORK 

Referring  to  Figure  2-2,  we  note  f!iut  to  achieve  a  maneuver  footprint 
of  600  meters  and  given  a  maximum  turning  rate  for  our  assumed  weapon,  the 
maximum  detection  and  classification  ranges  are  2.7  km  and  1.6  km  respectively. 
The  required  search  field  is  14°.  If  the  weapon  steers  straight  In  to  1.6  km, 
i.e.  does  rnt  initiate  steering  on  some  target,  the  ground  coverage  will  be 
reduced  40  percent  to  360  meters.  !f  one  second  is  allowed  for  classification, 
then  steering  on  the  target  will  commence  at  l.i  km  and  the  effective  ground 
range  is  reduced  again  to  approximately  248  meters.  Hence,  following  this 
scenario,  the  ground  coverage  has  been  reduced  by  41  percent  and  more  weapons 
are  required  to  Increase  the  ground  coverage  toward  the  required  amount. 
Unfortunately,  the  Increase  in  number  of  weapons  Is  non-linear  because  of  the 
statistics  of  ballistics  dispersion.  There  are  several  complementary  approaches 
followed  by  the  services  to  overcome  this  problem. 

One  approach  is  the  development  and  fahri cation  of  a  high  density  focal 
plane  array  FLIK:  one  estin.  te  Indicates  that  2-3  km  ‘s  an  achievable 
recognition  range.  With  this  device,  recognition  could  occur  at  2.7  km  or 
longer  (Figure  2-2)  and  thus  allow  the  required  600  meters  of  ground  coverage. 

A  second  approach  is  the  Advanced  Pattern  Matching  Program  of  NV&EOL 
which  requires  the  incoi./ng  weapon  to  pattern  natch  on  the  background  of  "fresh" 
reconnaissance  data,  and  steer  the  weapon  into  a  "basket".  In  terms  of  Figure 
2-2,  we  define  the  basket  to  be  1.6  km  from  the  target  and  centered  on  the 
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targeu.  Thus  as  the  weapon  closes  to  1.1  km,  and  as  It  performs  classification, 
the  target  Is  still  within  the  coverage.  Hence,  for  this  example,  the  pattern 
matching  algorithms  would  reduce  the  ballistic  uncertainty  from  600  to  248  meters. 

Both  of  these  approaches,  defined  In  terms  of  Figure  2-2,  would  allow  the 
weapon  to  begin  classification  at  or  longer  than  1.6  km  from  the  target.  We 
now  describe  an  approach  which  would  allow  the  weapon  to  begin  steering  on 
the  target  during  the  detection  phase.  This  approach  Is  complementary  to  the 
above  two  programs. 

3.2  EXTENDING  GROUND  COVERAGE 

As  ca>'  be  seen  from  Figure  2-  2,  the  ground  coverage  Is  maximized  If  target 
steering  can  be  Initiated  during  the  detection  phase,  l.e.,  from  2.7  to  1.6  km. 
These  numbers  represent  our  model  weapon.  With  a  Focal  Plane  Array  FUR 
and  use  of  the  Advanced  Pattern  Matching  techniques  these  numbers  would  be 
extended,  with  a  consequent  Increase.  However,  there  would  still  be  a  detection 
phase,  and  further  Increased  ground  coverage  could  be  achieved  If  target  steering 
were  Initiated  during  the  detection  phase. 

At  2.7  km  from  the  target,  (Figure  2-2)  detections  are  generated.  Under  the 
condition  of  a  massive  armor  attack,  described  In  Section  2.0,  a  number  of 
detections  will  be  found  in  the  field  of  view.  Some  of  these  detections  will  be 
target  detections,  others  will  be  false  alarms.  Of  the  latter,  there  are  two 
general  types:  (1)  those  that  persist,  and  (2)  those  that  do  not.  Under  a 
persistence  criterion,  alluded  to  in  the  Second  Quarterly  (Section  1.1),  the 
latter  category  of  false  alarms  can  be  virtually  eliminated,  in  our  experience. 
Th:s  Is  because,  in  closing  from  detection  to  classification  range,  there  are 
13  frames,  6  cued  frames  per  second,  of  detections  to  correlate  cued- frame 
to  cued-frame. 
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In  addition,  there  Is  the  possibility  of  target  prioritization  based  on 
motion.  Since  we  assumed  a  massive  armor  attack,  It  is  likely  that  the  targets 
are  moving.  Furthermore,  the  attacking  vehicles  are  probably  not  going  to  stop 
even  when  they  come  under  a  counter-attack.  The  13  frames,  collected  over  the 

2.2  seconds  from  detection  to  classification,  can  be  registered,  processed  for 
change  detection,,  and  for  kurtosls.  This  might  allow  the  weapon  to  discriminate 
between  moving  vehicles  and  tho:,u  which  have  already  been  hit  and  are  stationary. 
At  maximum  cross  track  velocity,  a  tank  could  travel  120  pixels  during  the  2.2 
seconds,  hence  change  detection  Is  viable.  False  alarms  then  would  comprise 
those  detections  which  do  not  persist,  or  If  they  do  persist,  do  not  have 
significant  motion  with  respect  to  other  detections  within  the  field  of  view. 

The  possibility  of  beginning  target  steering  at  the  detection  range 
rests  on  techniques  such  as  change  detection,  cueing,  and  kurtosls  -  histogram 
analyses  which  we  have  already  developed  In  the  Intelligent  tracking  phase 
of  this  work.  We  now  consider  another  Important  aspect  of  Intelligent  homing, 
namely  aimpoint  selection. 

3.3  AIMPOINT  SELECTION 

Aimpoint  selection  has  to  do  with  selecting  a  point  on  the  target  at 
which  to  aim.  This  is  important  for  several  reasons.  There  may  be  a  particular¬ 
ly  vulnerable  portion  of  the  target,  the  weapon  may  have  a  limited  capability 
warhead  which  requires  more  accurate  aiming,  and  the  weapon  steering  may 
require  the  selection  of  a  particular  limited  area  of  the  target  to  prevent 
the  steering  system  from  oscillating  about  the  target.  The  aimpoint  discussion 
Is  broken  down  into  two  parts:  (1)  aimpoint  selection  based  on  exterior 
features,  and  (2)  aimpoint  selection  based  on  interior  features. 
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3.3.1  Exterior  Based  Almpolnt  Selection 

The  exterior  based  almpolnt  selection  pt'ocess  Is  based  on  simple  moment 
measurements  of  the  binary  pattern  that  Is  p» educed  by  the  frame -to- frame 
tracker.  Use  of  a  binary  representation  Is  one  of  the  reasons  we  went  to  some 
lengths  to  demonstrate  the  tracking  capability  of  the  cuer-blnary  tracker 
combination.  Pixels  representing  the  target  are  replaced  with  an  array  of 
logical  "1" ' s;  all  other  pixels  are  zeroed.  Necessary  Inputs  to  the  almpolnt 
selector  are  target  class  and  aspect.  At  this  point  we  refer  to  the  discussion 
of  Section  2.0  and  place  these  two  requirements  within  that  context. 

Almpolnt  selection  depends  on  classification  which  may  be  achieved  at 
1.6  km  from  the  target,  according  to  Section  2.0.  Classification  could  occur 
at  longer  ranges  based  on  a  higher  resolution  sensor  and/or  a  higher  signal  to 
noise  ratio.  Further,  for  moving  targets  the  location  of  the  engine  hot  spot 
and  the  direction  of  target  motion  can  aid  classification  at  longer  ranges. 

It  may  be  possible  to  quantify  the  reliability  of  a  classification  at  longer 
range  based  on  the  particular  features  employed  and  the  persistence  of  a 
particular  classification.  In  the  case  of  low  probability  classification; 
steering  on  the  group  envelope  seems  an  appropriate  strategy.  Since  the 
Intelligent  homing  system  Includes  a  cuer,  classification  will  occur  as  soon 
as  the  cuer  makes  a  classification.  Aspect  determination  is  not  necessarily 
an  output  of  classification. 

Consider  a  simple  case  where  the  cuer  has  classified  a  target  and  Is 
heading  directly  for  the  target.  .That  is,  the  azimuth  angle  between  the  weapon 
and  target  is  zero.  The  problem  Is  to  determine  the  target  aspect.  Consider  a 
tank  moving  left  to  right  across  the  field  of  view.  The  hot  engine  produces  a 
bright  spot  on  the  target,  so  the  rear  of  the  target  is  identified.  If  the 
slopes  of  the  target  edges,  measured  in  the  image  plane,  are  90°  and  0°,  the 
target  is  aligned  with  the  sides  of  the  image.  If  the  slopes  are  120°  and  30°, 


then  the  target  Is  rotated  30°  in  the  Image  plane.  Thus  the  slopes  of  the  target 

edges  give  an  approximate  Idea  of  the  rotation  of  the  target  In  the  Image  plane. 

Length  to  height  ratios  also  Impart  Information  with  regard  to  the  target  rotation 
In  a  plane  containing  the  line  of  sight;  and  parallel  to  the  target  ground  plane; 

this  plane  Is  perpendicular  to  the  plane  of  the  Image.  This  approach  has  some 

value  in  weapons  such  as  Copperhead  and  Hellflre  which  are  roll  stabilized  and 
either  the  roll  or  roll  rate  Is  known  to  a  few  degrees.  For  the  missiles  which 
are  not  roll -stabilized  e.g.  the  longer  range  strategic  weapons,  the  trajectory 
and  their  terminal  "baskets"  are  such  that  they  are  coming  In  almost  vertically 
and  a  top  view  of  the  target  Is  presented.  It  should  be  mentioned  that  these 
vertical  ballistic  trajectories  present  problems  under  conditions  of  low  cloud 
cover.  We  will  present  examples  of  aspect  determination  in  Section  4.0. 

Prior  to  the  mission,  the  almpolnt  is  determined  by  analyzing  the  target's 
vulnerable  area  for  the  most  likely  mission  scenario.  Once  determined,  the  aim- 
point  information  Is  stored  in  terms  of  a  feature  vector,  F,  for  each  class  of 
target  ,  and  for  several  aspects.  During  the  mission,  a  target  Is  detected, 
classified,  and  Its  aspect  determined.  The  aspect  data  are  used  to  select  a 
feature  vector  from  memory  for  that  class  of  target  and  an  almpolnt  Is  computed 
on  the  actual  target  to  be  hit. 

The  feature  vector  Is  constructed  by  forming  a  silhouette  of  the  target 
for  a  typical  aspect  angle.  Here  the  silhouettes  can  be  divided  between  those 
typically  seen  by  a  low-flying,  roll  stabilized  weapon  and  those  top  views 
seen  by  a  ballistic  weapon  with  a  near  vertical  descent. 

Referring  to  the  former.  Figure  3-1  shows  principal  pattern  axis  drawn  on 
a  tank  and  a  desired  aimpoint  selected.  The  offsets  of  the  almpolnt  from  the 
four  intersections  of  the  target  with  the  principal  axes  (R1-R4)  as  well  as  the 
perpendicular  offsets  from  the  pattern  centroid  (R0)  define  the  aimpoint.  These 
offsets,  along  with  the  major  axes  of  the  pattern,  define  the  feature  vector. 


Y  PATTC^N  AM 3 


F  =  (SZX,  SZY,  ar  t>2,  a3. 


Figure  3-).  Aimpoint  Specification 
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The  binary  target  pattern,  used  by  the  tracker,  forms  the  basic  Input 
to  the  almpolnt  processor.  The  first  step  Is  to  perform  some  simple  measure¬ 
ments  on  the  pattern.  These  are  the  first  central  moments,  second  central 
moments,  and  joint  moment  : 
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where  n  Is  the  pixel  dimension  of  the  active  area  and  P^.  =  1  for  target  pixels 

and  =  0  for  non-target  pixels  within  the  active  area.  The  expressions  for 

X  and  Y  define  the  coordinates  of  the  pattern  centroid  (X, Y) .  This  will  be  the 

origin  of  the  principal  pattern  coordinate  axes.  The  quantities  cr2  and  o2 

x  y 

define  the  pattern  variances  along  the  x  and  y  axes  in  sensor  coordinates. 

The  quantity  a2  is  the  pattern  covariance.  Using  the  variance  and  covariance 
xy 

measurements,  the  angle  that  the  principal  axes  of  the  pattern  subtend  with  the 
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axes  of  the  sensor  (Figure  3-2)  is  given  by 


G  =  H  tan 


]. 


with  this  information,  it  is  possible  to  compute  the  variances  along  the  pattern 
axes  (x1,  y1  coordinate  system). 


a2,  ~  cr2  cos2  0  -  o  sin  20  +  a2  sin2  0 
x  x  xy  y 


a2,  *  a2  sin20  +  a  sin20  +  a2  cos20 
y  x  xy  x 


The  computations  for  a2,,  a2,  are  based  on  the  rotational  transformation  of  the 

x  y 

i,j  coordinates  (x,y  system)  into  i * , j ’  coordinates  (x',y‘  system)  using  standard 

techniques.  Also  used  is  the  fact  that  o  ,  ,  =  0,  by  definition,  in  the  x',y' 

x  y 

system. 

To  find  the  target  size,  we  must  find  those  pixels  contained  in  and  at  the 
edge  of  the  binary  image  which  lie  along  the  principal  axes.  These  are  shown  as 
pixels  R|,  Rg,  R^,  and  R^  in  Figure  3-2.  These  four  intersection  pixels  along 
with  the  centroid,  in  principle  axes  coordinates,  correspond  to  the  set  of  five 
reference  points,  in  image  plane  coordinates,  described  earlier. 


Figure  3-2.  Orientation  of  Axes  and  Target 
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Size  ratios  are  computed  as  the  ratio  of  the  measured  size  (SZX1,  SZY' ) 
for  the  current  pattern  to  the  stored  sizes  In  the  feature  vector  F: 

R$X=  SZXVF(l) 

RSY  =  SZY'/F(2) , 

where  SZX'  =  jRJ  -  Rj|  and  SZY'  *  |R£  -  R^|  In  the  current  pattern  and  F(l)  * 
|R1  -  R  |,  F(2)  *  |Rg  -  R^|  represent  the  reference  pattern. 


The  next  step  is  to  generate  estimates  of  the  aimpolnt  location;  an 
ensemble  of  five  aimpolnt  estimates  are  computed.  These  are  based  on  pairs 
of  reference  points  RQ,  R,,  ***  with  one  of  the  pair  constrained  to  lie  on  the 
x'  axis  and  the  other  on  the  y'  axis.  Figure  3-3  shows  the  pairs  where  F(l), 
F(2),  F ( 8)  refer  to  SZX,  SZY,  a^,  b2,  a3>  b^,  Px>  Py  respectively  from 

Figure  3-1.  Note  that  F ( 1 )  =  SZX,  ****  F(8)  =  Py.  From  this  ensemble  of  five 
aimpoint  estimates, { ( APX1- ,  AP^,.)  i  -  1,5)  a  composite  aimpoint  can  be  determined. 


REFERENCE 

x  *  COORDINATE 

y'  COORDINATE 

RO,  R1 

RSX  F(7) 

RSY  F ( 8) 

Rl,  R2 

Rl  +  RSX  F(3) 

R2  +  RSY  F(4) 

R1,R4 

Rl  +  RSX  F(3) 

R4  +  RSY  F( 6) 

R3,  R2 

R<3)  +  RSX  F(5) 

R2  +  RSY  F( 4) 

R3,  R4 

R3  +  RSX  F(5) 

R4  +  RSY  F (6) 

Figure  3-3. 

Tabulation  of  Reference  Point  Pairs 

and  Corresponding 

Aimpolnt  Estimates  in  Terms  of  Size  Ratios,  Reference 
Point  Locations  and  Stored  Data 


A  few  comments  concerning  redundancy  are  in  order  here.  If  the  pattern 
formation  and  measurement  processes  are  perfect  and  noise  free,  then  all  five 
aimpoint  estimates  should  be  degenerate.  These  preconditions  however,  are 
most  unlikely  to  occur.  Therefore,  it  is  expected  that,  at  the  very  least. 


I 
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two  or  more  estimates  will  be  different.  The  aimpoint  ensemble  may  be  thought 
of  as  defining  an  area  on  the  target  pattern.  A  composite  aimpoint  can  be 
computed  as  the  arithmetic  or  weighted  mean  over  the  ensemble.  Before  this 
is  done,  a  simple  test  for  ensemble  members  is  to  determine  If  they  lie  within 
the  binary  pattern.  It  should  be  noted  that  the  RSX  and  RSY  allow  the  aimpoint 
estimate  to  be  updated  with  decreasing  range. 

As  the  range  closes,  the  target  becomes  larger  and  larger  and  the 
tracker  must  handle  a  larger  and  larger  track  window.  Preliminary  estimates 
seem  to  indicate  that  a  64x64  pixel  window  will  require  special  computation 
procedures  which  take  more  time  and  yield  results  which  are  not  as  rell  :>le  as 
those  achieved  with  the  more  straight-forward  computations  for  smaller  windows. 
Hence,  based  on  limitations  of  the  frame- to-frame  tracker,  a  64  pixel  target 
appears  as  a  natural  transition  to  aimpoint  selection  based  on  interior  features. 


3.3.2  Interior  Based  Aimpoint  Selection 

Based  on  the  analysis  of  Section  2.0,  and  the  above  constraint,  the 
range  has  closed  to  approximately  200  meters  (for  target  side  view)  when  the 
aimpoint  selection  technique  switches  from  exterior  to  interior  features.  At 
500  meters/second,  the  time  to  impact  is  0.4  sec  and  12  frames  of  data  are 
available.  At  27  meters  from  the  target,  the  target  image  fills  the  field  of 
view. 

An  issue  here  is  that  range  at  which  the  intelligent  homing  system  is 
constrained  to  concentrate  on  only  one  target.  Again  from  Section  2.0,  we 
note  that  the  guidance  settling  occurs  in  the  last  500  meters  to  the  target. 

In  the  region  from  1.6  km  to  0.5  km,  the  intelligent  homing  system  can  track 
all  the  targets  within  the  field  of  view  and  must  coirmlt  itself  to  the  highest 

priority  one  before  the  500  meter  mark  is  passed.  Consider  now  some  character¬ 
istics  of  the  aimpoint  based  on  interior  features. 
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Clearly,  the  almpolnt  should  represent  some  vulnerable  area.  From  the 
standpoint  of  Image  processing,  the  almpolnt  should  be  a  high  contrast  region 
with  regard  to  the  rest  of  the  target.  It  should  be  repeatable  from  frame-to- 
frame  and  not  scintillate  or  fluctuate. 

In  conclusion,  we  feel  that  the  interior  almpolnt  selection  problem  is 
not  one  of  identifying  the  desired  point  out  of  context.  Rather,  the  target 
has  been  classlfed,  the  aspect  has  been  determined,  and  an  almpolnt  based  on 
exterior  features  selected.  The  aimpoint  selection  based  on  interior  features 
should  be  in  approximately  the  same  location  as  the  former  and  more  time  will 
be  allotted  for  the  calculation.  That  is,  from  500  meters  until  27  meters 
to  impact,  the  entire  field  of  view  need  not  be  processed. 
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4.0  PRELIMINARY  RESULTS 


This  section  is  divided  into  two  parts:  (1)  long  range  aimpolnt  selection 
and  homing,  and  (2)  close-in  aimpomt  selection  and  homing.  Further,  the  transition 
region  between  the  two  and  the  reasons  for  the  dichotomy  are  discussed.  Three 
examples  from  the  NV&EOL  data  base  are  presented. 

4.1  LONG  RANGE  AIMPOINT  SELECTION 

Long  range  aimpolnt  selection  is  based  on  the  technique  described  in  Section 
3.3.1,  Exterior  Aimpolnt  Selection.  At  long  range,  the  exterior  shape  is  a 
reliable  and  repeatable  feature.  This  section  provides  an  example  of  long  range 
aimpoint  selection  taken  from  the  NV&EOL  data  base  described  in  the  First 
Quarterly  Report.  Section  2.2.5,  Tape  #5,  11/15/77,  Tape  Position  5280  is  a 
side  view  of  a  tank  moving  perpendicularly  to  the  field  of  view  from  right  to  left. 

The  median  filter  was  deleted  In  this  example  only  because  we  were  looking 
for  a  small  engine  hot  spot  in  the  segmentation  process.  Hence,  the  aimpoint 
selection  and  tracking  are  based  on  the  binary  values  resulting  from  the 
segmentation  processes  described  in  previous  quarterlies  with  the  deletion  of 
the  3x3  median  filter  for  this  example  only.  The  model  for  the  aimpoint  selection 
is  shown  in  Figure  4.1-la. 

In  Figure  4.1-lb,  we  have  arbitrarily  assigned  values  to  each  of  the  eight 
members  of  the  feature  vector.  We  place  the  coordinate  system  at  Rg  and  the 
directions  along  the  principal  axis  are  the  same  as  the  sensor  coordinate  system: 
i.e,  down  is  positive  and  left  to  right  Is  positive  as  shown  in  Figure  4.1- la. 

In  this  coordinate  system,  R3  and  Rg  have  negative  coordinates  (-x',0)  and  (0,-y') 
respectively,  while  Rj  and  R^  have  positive  coordinates.  Figure  4.1-lb  shows  the 
quantities  for  the  reference  vector;  note  that  some  of  the  quantities  are  signed 
values  Indicating  direction.  The  aimpoint  is  labelled  AP  and  shown  with  an 
asterisk  (*). 
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Figure  4.1- la.  Principal  Axes  Directions. 
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Figure  4.1-lb. 

Reference  Quantities 

The  following  figures  show  the  binary  target  shape  from  the  frame- to-frame  tracker, 
described  in  Section  1.0  and  previous  Quarterlies,  for  consecutive  images 
224,  228,  232,  236,  240,  244,  248,  252,  256,  and  260.  The  aimpolnt  calculations 
are  shown  below  each  shape  and  the  aimpolnt  is  superimposed  on  the  target 
silhouette.  We  describe  the  aimpolnt  computation  for  Image  224  In  some  detail 
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and  then  present  the  remainder  of  the  Images  and  their  almpolnt  computations. 
Image  224  Is  shown  In  Figure  4.1-2.  The  first  and  second  central  moments  are: 


i 


p  < 

f-1 


3  1  n  •  11 

2  =  XBAR  «  i  E  Z  j  P 


j+1  1=1 


1j 


Y  =  YBAR  =  rr  Z  IP,,, 
u  j=l  1=1 

n  n 

where  U  =  Z  Z  p,<,  and  1  and  j  are  the  row  and  column  numbers  starting  from 
1=1  j»l 

the  upper  left-hand  corner  of  the  track  window.  The  first  central  moment  Is 
computer  on  a  binary  Image  by  summing  the  number  of  "1"  pixels  In  each  column 
and  multiplying  by  the  column  number.  These  products  are  then  summed  and 
divided  by  the  number  of  "1"  pixels  In  the  Image.  Thus, 


jS 


X  =  XBAR  =  1.56^0x6  +  11x6  +  12x9  +  13x9  +  ...]  =  17.78  and, 

Y-YBAR  =  156 [6x6  +  7x4  +  8x12  +  9x14  +  ...  ]  =  1888/156  *  12.10.  The 

variances, 


,  n  n 

*  U  E  1 
x  U  1  =  1  j=l 


J2  P 


1j 


(XBAR)1 


n 


o2  =  i  E  Z  I2  P^  -  ( YBAR) 3 


U 


y  u  1=1  j=l 

can  be  evaluated  In  a  similar  fashion  as  well  as  the  expression  for  the  joint 

moment,  a  .  The  XBAR,  YBAR  pixel  truncated  to  (17,  12)  Is  shown  circled  In 
xy 

Figure  4.1-2.  We  note  that  o  ,  o  provide  a  rough  measure  of  the  target  extent 

x  y 

in  the  x,y  directions  as  measured  by  the  coordinates  of  the  image  plane.  The 
angle  that  the  principle  axis  makes  with  the  Image  coordinate  system  Is  found 
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Figure  4.1-2.  Image  224  and  Almpolnt  Computations 
by  substituting  Into 

0  =  tan-1  [ - ^ —  ]  =  tan"1 

and 

G  =  -7.9°. 

Thus  by  a  rotation, 

x'  =  x  cos©  -  ysln  0 
y'  =  -x  sin  0  +  y  cos©, 
a  point  along  the  Image  plane  ax€s  can  be  mapped  Into  a  point  along  the  principal 
axes.  The  coordinates  of  the  perimeter  points  along  the  principal  axes  can  be 
found  from  this  equation.  In  fact,  all  four  perimeter  points  are  shown  In 
Figure  4.1-2  as  circled  pixels  along  the  principal  axis.  In  order  not  to  clutter 
Figures  4^1-2,  the  perimeter  points  Rj,  Rg,  Rj,  and  R^  are  shown  In  Figure  4.1-3 
with  Rg,  the  centroid.  These  pixels  correspond  to  those  of  the  model  target 
shown  in  Figure  4.1-la.  • 


1.227 


(9.425-18.094) 


Figure  4.1-3.  Location  of  Principal  Axis  - 
Perimeter  Pixels 

The  next  step  Is  to  determine  the  size  of  the  actual  target  with  respect 
to  that  of  the  model.  In  hydrodynamic  modelling,  this  Is  the  constant  of 
proportionality.  From  the  actual  target.  Image  224,  SZX'  *  |R1  -  R3|  and 
SZY'  «  |R$  -  R4| 

SZX'  =  [  (23- 10) 2  +  (13-11)2  ]**  ■  13.2 
SZY'  *  [  (18-17)2  +  (17-7)2  ]**  =  10.1, 

and  the  model  target  has  SZX  =  4,  SZY  2  3.  Hence  the  constants  of  proportion¬ 
ality  are  RSX  =  SZX'/F(1),  RSY  =  SZY'/F(2)  which  becomes  3.25  and  3.3,  respect¬ 
ively. 

Now,  we  compute  five  estimates  for  the  aimpoint  based  on  various  combinations 
of  Rq,  Rj,  R2,  R3,  and  R^.  The  five  sets  of  coordinate  expressions  are  described 
In  Section  3.3.2  and  the  appropriate  numbers  for  this  example  are  shown  In 
Figure  4.1-4.  Note  that  the  aimpoint  coordinates  are  referenced  to  the  target 
centroid,  but  they  are  measured  along  the  x,y  axis  centered  at  the  centroid  Instead 
of  the  x',  y'  axis  for  the  Illustrations. 
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REFERENCE 


X'  COORD 


Y*  COORD 


f  f 


Rq,  Rj  rsx  • 
R1$  R2  R1  +  RSX  • 
R1  ,  R4  Rj  +  RSX  • 

R3»  R2  R3  +  RSX  * 
R3»  R4  R3  +  RSX  * 


F(7)  -  3.25  x  -1 
F( 5)  -  6  +  3.25  x  (-3) 
F(5)  *  6  +  3.25  x  (-3) 
F( 7)  «  -7  +  3.25  x  (+1) 
F(7)  »  -7  +  3.25  x  (+1) 


RSY  •  F(8)  -  3.3  x  0.5 
R2  +  RSY  •  F(6)  ■  +5  +3.3  x  (-1) 

R4  +  RSY  •  F(4)  -  .5  +  (3.3)  x  (+2) 

R2  +  RSY  •  F(6)  -  +5  +3.3  x  (-1 

R4  +  RSY  •  F( 4)  -  .5  +  (3.3)  x  (+2) 


Figure  4.1-4. 


Almpolnt  Coordinates  In  X',  Y'  Coord. 


\  . 


Having  described  the  fl rst» example  In  some  detail,  we  now  proceed  with  the 

following  Images  In  the  series  noting  that  they  are  tracked  by  the  frame-to- 

frame  tracker  and  the  almpolnt  Is  computed  from  the  tracker  binary  reference  Image. 

Figures  4.1-5  through  4.1-13  show  the  almpolnt  computations  for  Images  228, 

232,  .  260.  In  general,  four  of  the  almpolnts  cluster  very  well,  while 

the  one  based  on  the  target  centroid  Is  consistently  off  by  one  to  three  pixels. 

Further,  the  almpolnt  computations  .ire  putting  the  aimpolnt  In  the  upper  left- 

hand  portion  of  the  target  as  the  template  requires  In  Figure  4.1-1.  There  Is  a 

variance  in  the  principal  axes  angls  of  -6  degrees  to  about  -15  degrees.  For  the 

next  Quarterly,  we  shall  repeat  several* of  these  Images  using  median  filtered 

data  to  test  for  the  variability  of  the4princlpal  axes  angle  with  a  more  compact 

1  * 

target.  In  conclusion,  the  aimpolnt  calculations  seem  to  be  placing  the  almpolnt 

within  a  few  pixels  of  the  desired  point  which  Is  adequate  at  these  ranges  since 

» 

»» 

there  Is  sufficient  time  remaining  before  impact  to;make  adjustments.  It  appears 

V 

that  majority  vote  Is  an  appropriate  strategy  to  select  a  single  almpolnt.  Note 
that  the  major  reason  for  the  congruence  between  the  first  almpolnt  and  the  others 
is  the  compactness  of  the  target.  To  the  extent  that  oufylng  pixels,  not 
connected  to  the  main  body,  move  the  centroid  from  the  center  of  the  main  body, 
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Figure  4.1-7.  Aimpolnt  Computations,  Image  236 
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Figure  4.1-8.  Aimpolnt  Computations,  Image  240 
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Figure  4.1-g .  Aimpoint  Computations,  Image  244 
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Figure  4.1-10.  Aimpoint  Computations,  Image  248 
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Figure  4.1-1 1.  Aimpolnt  Computations,  Image  252 
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Figure  4.1-12.  Aimpoint  Computations,  Image  256 
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the  aimpoint  will  be  different.  The  model  for  the  first  aimpoint  assumes 
that  Rq  is  equidistant  from  RJ  and  R^. 

Figure  4.1-14  shows  the  aimpoint  for  images  229,228, .. .260  where 
median  filtering  has  produced  a  more  compact  target  representation. 
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Figure  4.1  -  14.  Aimpoint  Computations,  Images  224,... 260 
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4,2  Close-In  Homing  and  Almpoint  Selection 

The  purpose  of  this  section  Is  to  discuss  several  preliminary  problems 
which  must  be  solved  In  order  to  accomplish  close-in  homing  and  almpoint 
selection.  The  first  problem  is  segmentation  of  a  close-in  target  and  the 
second  is  frame- to- frame  tracking  of  such  a  target. 

4.2.1  Close-In  Segmentation 

Segmentation  of  a  large  target,  30  lines  or  more,  introduces  several 
differences  from  segmentation  of  a  small  target.  The  smaller  target  can  be 
segmented  as  a  light  target  against  a  dark  background  or  vice  versa.  A  large 
target  may  consist  of  both  light  and  dark  portions;  hence,  segmentation 
techniques  for  large  targets  should  be  bipolar.  A  second  difference  is  found 
in  the  interior,  structural  features  which  are  present  in  the  large  target. 

These  features  may  exhibit  the  "blob-like"  characteristic  of  a  small  target, 
i.e.,  there  exists  a  general  decrease  in  gray  level  as  one  moves  from  the 

center  of  the  blob  to  the  edge  in  any  direction.  However,  th..se  features  may 
also  exhibit  "con tour- like"  characteristics,  i.e.  the  gray  level  does  not 
diminish  isotropically  as  one  moves  from  the  center  but  may  increase  in  one 
direction  and  diminish  in  the  opposite  direction.  As  an  example  of  close-in 
segmentation,  we  consider  images  from  the  NV! COL  875-line  data  base  described 
in  the  First  Quarterly  Report.  The  scenario  is  described  in  Section  2.2.5  "Tape 
#5  11/14/77",  Tape  Position  5280.  The  helicopter  is  closing  on  a  moving  tank 
from  the  rear;  the  tank  is  moving  along  a  narrow  road.  We  shall  show  in  this 
example  that  it  is  possible  to  segment  the  target  better  by  moving  beyond  the 
superslice  threshold  which  gives  the  maximum  edge/perimeter  matches  and  consider 
the  kurtosis  (texture)  ideas  derived  in  the  Third  Quarterly  Report.  This 
allows  us  to  determine  target  aspect  which  facilitates  aimpoint  selection. 
Further,  by  means  of  the  same  kurtosis  ideas  used  in  the  disappearing  and 


reappearing  target  cases  of  the  Third  Quarterly,  we  can  estimate  the  threshold 
at  which  target  background  merging  occurs. 

Figure  4.2-1  shows  the  segmentation  for  the  tank  at  a  threshold  of  12; 
essentially,  the  segmented  portion  Is  the  hot  engine.  Figure  4.2-2  shows  the 
number  of  edge/perimlter  matches,  average  gray  level,  average  x  position, 

average  y  position,  width  (DELX),  height  (DEL/) .'.total  number  of  pixels,  and 

f 

numoer  of  perimeter  points  vs.  the  superslice  threshold.  Note  from  the  figure 
that  the  maximum  number  of  edge/perimeter  matches  occurs  at  a  threshold  of  35 
and  that  image  is  shown  in  Figure  4.2-3.  Continuing  beyond  the  threshold  for 
maximum  edge/perimeter  matches,  we  obtain  Figure  4.2-4  at  a  threshold  of  37. 
Here,  we  can  see  the  beginnings  of  the  distinctive  gun  barrel.  Figure  4.2-5 
shows  the  same  image,  thresholded  at  38  and  the  ensuing  merging  with  the  back¬ 
ground.  Note  the  large  jump  in  the  number  of  pixels  contained  in  the  target  at 
a  threshold  of  38  and  the  large  jump  in  the  average  gray  level.  This  jump  is 
similar  to  the  jump  in  target  size  for  the  disappearing  target  case  when  the 
backgournd  was  included  in  the  target  shape.  Further,  the  large  expansion  in 
the  target's  x  dimension  leads  one  to  suspect  that  the  additions  are  not  part 
of  the  target.  An  added  degree  of  sophistication  could  be  achieved  by  tracking 
the  background  blobs  as  they  form  and  computing  their  probability  of  being  part 
of  the  target  by  their;  additions  to  the  target  dimensions.  Figure  4.2-6  is  the 
descriptive  table  of  target  characteristics  for  image  1804.  Almost  the  same 
thing  happens  again  except  there  are  several  maximums  in  2804.  Again,  they  are 
passed  on  the  way  to  the  best  target  description. 

In  conclusion,  it  is  seen  that  a  more  complete  segmentation  of  a  close-in 
target  can  be  achieved  by  taking  into  account  not  only  the  maximum  number  of 
edge/perimeter  matches  but  the  average  gray  level  across  the  target  and  the 
number  of  pixels  added  to  the  target  at  each  gray  level.  In  the  next  quarterly, 
we  hop*'  to  reduce  these  heuristics  to  something  more  concrete  based  on  further 
examples? 
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Figure  4. 2-5. 


Segmented  Target,  Image  1784,  Threshold  =  38 
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Figure  4.2-6.  Target  Characteristics  vs. 
Superslice  Threshold,  Image  1804 
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4.2.2  Close-In  Targev  Tracking 

Close-In  Target  Tracking  on  a  frame- to  frame  basis  runs  headlong  Into  the 
*  *1 

existence  of  targe?,  3: V tours  as  described  In  the  previous  section.  Some  of  the 
problems  In  tracking* at /interior  feature  are  described  here.  Recall,  that 
the  Intelligent  tracker  systcln  concept,  described  In  Section  1.0,  requires 

i A 

that  the  cuer  segment  the  entire  frame  and  provide  a  reference,  gray  level 

target  Image  to  the  tracKef.  This  reference  image  Is  binarized  by  the  tracker 

% 

under  the  assumption  that  there  Is  a  difference  In  gray  level  between  the  target 
and  Its  Immediate  surr^indings.  The  contour  affects  the  cuer  segmentatlor:  and 
the  blnarlzatlon  of  the  tracker  reference  Image.  At  the  segmentation  level, 
consider  a  target  which  has  an  Isotropic  gray  level  distribution  for  the  engine 
hot  spot  and  the  remainder  of  the  target,  consists  of  contours.  That  Is,  there 
are  definable  edges  to  the  contours,  but,  In  general  the  gray  level  darkens  with 
distance  away  from  the  engine  spot.  The  Superslice  algorithm  will  segment  the 
engine  hot  spot  but  will  also  include  it  within  the  target  as  the  gray  level 
threshold  Is  increased  and  a  maximum  number  of  edge/perl meter  matches  Is  sought. 
Individual  contours  can  be  Isolated  by  additional  processing  such  as  the  employment 
of  bands  or  ranges  of  thresholds.  For  example,  recall  the  road  crossing  case  In  the 
Second  Quarterly.  Additionally,  the  number  of  edge/perimeter  matches  may  achieve 
several  local  maxima  before  the  entire  target  is  segmented.  In  summary, 
additional  processing  must  be  added  to  Superslice  to  isolate  structural  features 
and  segment  the  entire  target.  More  significantly,  the  presence  of  contours 
affects  the  tracking  process  and  the  formation  of  a  binary  reference  image.  In 
Figure  4.2-7,  we  show  such  contour  with  a  square  contained  in  it,  shown  by 
dashed  lines.  The  major  thrust  of  gray  levels  is  from  light  to  dark  In  the 
direction  of  the  arrows.  There  Is  enough  contrast  along  the  vertical  sides  of 
the  square  to  obtain  the  vertical,  dashed  edges.  However,  the  presence  of  gray 
levels  in  the  contour  close  to  those  gray  levels  within  the  square  means  that 
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Figure  4.2-7.  Track  Square  with  Contour 

the  contrast  across  the  vertical  edges  is  low.  In  oth^r  words,  the  gray  levels 
in  the  reference  target  background  will  be  close  to  those  In  the  reference 
target  image  (the  square)  and  the  track  window  may  wander  about  the  contour. 

-  As  an  example,  a  3x3  square  just  ahead  of  the  hot  engine  signature  was 
chosen  by  eye;  this  square  seemed  fairly  repeatable  in^e  series  of  Images:  1784, 
1788,  1792,  1796,  1800,  1804*,  1808,  1812,  1816,  1820,  182?,  1828,  1832,  1836, 
and  1840.  These  are  taken  from  the  set  of  images  ^escribed  In  Section  4.2.1. 

The  square  was  selected  on  Images  1784,  1804,  and  1824;  this  selection  process 
was  a  substitute  for  the  cuer.  The  Intervening  four  Images  1788-1800,  1808-1820, 
and  1828-1840  were  tracked  with  the  binary  correlation  tracker  described  In  the 
Third  Quarterly  Report.  Tracking  was  attempted  on  the  raw  gray  levels  and 
gray  levels  processed  with  a  3x3  median  filter.  In  both  cases  the  results  were 
sporadic.  The  problem  seemed  to  be  that  the  square  we  had  chosen  was  really 
located  in  a  contour  of  approximately  the  same  g^ay  levels  as  shown  In  Figure 
4.2-7.  The  tracker,  then  could  move  about  the  contour  with  the  accompanying 
change  in  shape  of  the  reference  as  it  was  hande>1  from  frame- to- frame.  Thus 
by  the  fourth  track  frame,  the  aimpoint  shape  had  changed  substantially. 

Figure  4.2-8  shows  several  successive  track  windows  from  the  3x3  median  filtered 
data. 

Based  on  this  data,  we  decided  to  track  over  the  entire  segmented  target 
as  shown  in  the  previous  section  using  extended  edges  or  subsets.  This  would 
allow  us  to  take  advantage  of  the  repeatability  of  a  large  number  of  extended 
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Figure  4.2-8.  Successive  Track  Images, 
Binary  Correlation  Tracker 


edges  contained  In  the  target.  Then,  at  the  very  worst,  the  almpolnt  could  be 
computed  as  previously  described  In  the  long  range  case.  We  note  here  that 
this  approach  Is  viable,  assuming  a  program  driven  processor,  because  the 
projectile  will  probably  have  to  settle  on  a  single  target  by  the  time  the  Image 
Is  30  or  so  lines  high  (refer  to  Section  3).  Hence,  there  is  no  need  to  scan  the 
entire  field  at  this  point.  To  prove  feasibility  of  frame- to- frame  registration 
using  edges,  we  compare  the  accuracy  of  registering  edges  from  the  segmented 
target  shape  with  the  accuracy  of  registering  an  entire  128x128  window.  Both 
of  these  are  registered  against  the  128x128  window  of  the  next  image.  Twenty- 
five  edges  were  used  for  target  registration  and  ninety-seven  were  used  In  the 

window  registration.  If  the  registration  results  are  approximately  the  same,  then 
successive  registration  over  the  approximate  target  location  and  target  size  can 
be  used  for  close-in  aimpoint  selection  and  homing.  Registration  accuracy  Is  in¬ 
versely  proportional  to  the  square  root  of  the  number  of  matching  edges.  Hence,  a 
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larger  number  of  edges  are  found  in  the  128x128  window,  and  registration 
between  windows  will  be  more  accurate.  This  will  be  the  standard  for  comparison. 

However,  at  close  range,  the  density  of  repeatable  edges  over  the  target 
should  be  higher;  hence,  successive  registrations  should  be  fairly  accurate  also. 
The  images  for  the  example  are  taken  from  the  NV&EOL  875-line  FLIR  data  base 
described  in  the  First  Quarterly,  Section  2.2.5  "Tape  5  11/14/77",  Tapf  Position 
5060.  The  helicopter  is  closing  on  a  tank  moving  along  a  narrow  road;  the 
helicopter  approaches  the  tank  from  the  rear.  The  thinned  gradient  output  produced 
by  the  Westinghouse  AUTO-Q  System,  described  in  Appendix  A  of  the  First  Quarterly, 
is  shown  in  Figure  4.2-10  for  image  1784.  The  gradient  directions  are  quantized 
at  45°  increments  as  shown  in  Figure  4.2-9  which  also  shows  the  encoding  for  the 
computer  output.  The  circular  area  is  the  hot  engine  of  the  moving  tank  as  seen 
from  the  rear.  Above  the  engine,  one  can  see  gradients  representing  structural 
features  of  the  top  and  forward  portions  of  the  tank.  The  two  vertical  lines 
drawn  in  by  pencil  represent  the  edges  of  the  narrow  road  upon  which  the  tank 
is  travelling.  Figures  4.2-11  through  4.2-15  show  the  thinned  gradient  display 


Figure  4.2-9.  Gradient  Directions 


««***.**.* . . . R..0fff  •<«<«?..? 

062**22 . ..•••..... . . 10088  «  «  *  •  .♦  '•>?. 

*  •  f. . . . . * . 02  2*222 * . 

. . . . *  2  • . i 00 00... 4444444 

. . . . . . .  .  . . 4  •  ..  .  •  .1 88  838 •  .  4.2  2  24'* 

*  •  •  4  4  •  •  •  •  c  •  •••  «  *  *  #  .  •  •  .  2  ....•««*•. #*«.00022^«... 22* « 

* *444«..«2< •••••*♦••••*•••• ... . 220.2.  ... .00. ... • • 0000. .2444. .2. 

44422.4  . . . . .20 00.00.. ....00008.. .2. 2 4.. 

^2  2 2 2*.  ......  ......  ....  ....... ..  ••..2..*..*......0000«.«..?. ... 

. . . . 00 . 1 . 000 . 00  00.  ...0 . 

*  •  •  •  .  . .  •  ... ....  .2. .00..  ..  i  .  .  .00.  .222000000000.  •  .08.8. 0.020000.  • 

*  *  2  •  .  •«/»•  .......  ...  ....  .  .  .  ..  «.  .  .  .  ..0  * .  .  .  00 .2000 .8888888  ...2.4.  . 

.0000.0  0.0 . . . . . 0... 00.00. 22 . 0008 . 4  4  . 

.  4  4 . 0  .  .  •«$••».  .....  •  ..  ..0.000  ..  22  *2220.00...  2...  ..22222 .644444  ,  t 

*  2  2  •  *  *  •  ..0...«.«..0.....  00..  ...  .0222.0*.  .*#2. #*...*  000..  .  .  2  .  •  .  . 

. 2 . • 0 . ......... 0.0.0*. ...... ...8.00... .....22... .888.. .  .  •  « 2. •  o  • 

.0.  .000 . ..0...0.I..4. . 0 0... . 22 . 0  888.64.2?... 

•  • 2  ...  2. 00. ....... .2000000.. .. «.c.0. ...... 2. 2. ...... 088... .2... 


4  .46  64  . 


'  •  *  •  2  2  .  • 20.. ....... .222. 2. .•••••22. 08.. 4.2. •• 


.244.**..*?2*.*0 . . . 22  ...  . 42444 . 08. .444. .8 


. 4 . . « • • ....... 222. 22. .000...0. .20......  ... .00000. ....8... 

*4  «  •  •  .  .  ..202222...  .00.000.20 .  *  .  r  .  •  ..........  ....0. .......  . 

•l  4  6  • . , «  .  00.  000.  ........  ..0. ........ 

•  .. • . . . .« ... .2.0.00. ..22...... ••2.2.. •  •  •♦•0.....44f>» 

•  ... . • . «  .... . • ♦ . n • • ....02000.00.000... .....2... 

. ... « . « « ..... .. .0.. .....020. ..000.0. .#00.00000.. •«.«.«.  ....2... 

.... •••»••*• .••..2JO..0...2..00 .0000. 000  ..2.. • .. .......  ...... . • • 

i • • » .. • *  ....... • •  0  • .. • . 2220 • .... 0.00.. ...24444. ....... .»«.4...« 

. «  « . . . . . • .. ...... .00.. .220  ..0. ..0.. ..0.0.2...... ......  ....4. ... 

. ... m . . « . «0.....«...0.. 222000000.  .00000  ..0.... ........  ......... 

•  «*. • .* . . ...  ...... .0... ..2. •• ..0000. .000000. ..........  ......  ... 

•  • *  *  ... • . •  •  • • .. ... . • ... 22200000000. 00.000000. ..0 ...... .  ... .4  •  .  0 

*  •  •  •  *  .............. 222222. 000000000000000000*. • 22. ........... «0 

. . 0.  .  . 222 22220  000000  0000000000000 . . . 0.... 

,4.4  .•/) . 2.2  2222220..  ..0..  00. 0  0000000000..#. . 0 . 

4  » » t . • 0  « ..2 2222222... ••  0.00. .000000000000.. 

« • % . 2 . . ••2222222222. 2». 2. .00020000^0000000000000... .2*. .. 

. . . 222222222 . 2?22.?2..m, . 

»  «  * .  .  8  «  H  .  .  •  2222222222  .  .  •  •.  .  .  ..  .....  ...2...2?22«*  .  2.  •  •  •  .  ••?44£68 

. t . 0 022222 . .  ...0000.../ . . . 

•  •*• ...00. ...022222. .........  ....... . • • . • 0 000 to0 0000. .£?•«.. 2... 

%••.*«. 00.. «0000220.*»«s. 0000  000000. 22... 4. • . . 

•  . « • 4  4 • « • ... 00222.... •• « .... • . . • . ....... ..000000. 2222.... .44... 

4  .  .  •  .  •  ft  00002  .......  a.  ....  ..  .......  •4..00I)..  22222444*.  .2... 

•  ... «•• *  •  ••«  00002.  .... . . • ... ..  .  ....  •  ........ 00. .. .0. 22. «..#•  ... 

•  . *  *  « •••*.«» 00000. ..*.0... .... . . ...... ...#•••0000. 2222?.. ...... 

*  . . . 21. .  •  .0. .00  00. .. . .0. . . . . . ..2.8. .002222222 . 

. 0  •  .0000 . . . .2.0.  ••  22224444 . . 

.......  ..22222222 . 0..... . . . 44.44  44  444  4  . 

*  «  ♦  .  •  •  •  2222. 00  ££.2..*.0..r.....«  •  .  .  .  ••••##  v*.#  ^2  224444  «  0  .  .  *  • 

*  ♦  ♦ . ... .0....I8 88 ••••••. •*•••• ..00. ........ 202222224 •  .00. « . • . 

. . 008.. 0010 . ...  .0.0.. > . 1. ^2222244... I* . 

022000  •  .  .2.  ......  .8.8.  ♦•£••••  f  Jv*  •  •  •  •  • 

.....•«•«••• 0000. ..0. ......... •• 2. •  • •  •M#240£44M*«rfl*  •• •••• 


%  •  «  «  .  .6!,,ft68ft.8ftftft.ftft«  .........22 ....... .22. #22222222.«0.0..«  •  •  8 

...  •  .•.ft.6.ftftftftft866Hvj.*.a«****00**#*  >•  •  2  •  *  *  •  4222222?.  •  •  0  *  *  *  *  «*8 

/  . B8RK  B6  6B8  86.  4 . f>. .44444? ’22.  ••  •£•••.«•• 


... 

•  t  •  •  «  4  •  •  6  8  (1 

•  4  4  44...** 

•  2 .  .  •..  .... 

°  »  .  _  *  „ 


4  •  *l  *  ■>•*... 

u  4  <, P)  .  ft  «... 
.  . . 


.0.. 

» . • ««••?«#• 

?2...**0««* 


.68666666666.  ..  .  . . 664444444.2 

68866  68888888.. •• . 6666*  64444444444 

.88.68888888.6666.6666666666664666444. 
. .8.6888 888866666 666446666666644 46642. 

. ft  8  8  8  8  8  6  6  6  6  6  6  6  6  6  6  4  6  6  6  6  6  6  4  4 . ..... 

. . h 6 • 68  8  68866  66666 6  6 66  6  6666666666. . #  .  • 
. . • • . • .888*8*06  66 6 66 *.4644 6.  ..••66.  ... 
.. ...  .  *  .  ft  ft  0  .  « .6  6666444444.. • ...  ...  •  ... 
.. ... ...8.8.. .... ..42.  .  *?  o .......  ..... 


•  ...  0 


. . 88888  .  •  . 
.....0.... 
*. ..22.  .  *  . 
....2 . 


4 *?••*••• 

.  .22.44... 

. *.2.2.*. 


...*BD...**» 

•  «.«*••••  .  •  • 

...  ..0...  ... 
...22....... 

... .02... * .  • 

. * . 08  ....... 

... .0....  ... 

.........  .4. 

...ft...*. ... 

....8....... 


Figure  4.2-10.  Thinned  Gradient  Direction  Display,  Image  1784 
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Figure  4.2-11.  Thinned  Gradient  Direction  Display,  Image  1788 
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Figure  4.2-12.  Thinned  Gradient  Direction  Display,  Image  1792 
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Figure  4.2-13.  Thinned  Gradient  Direction  Display,  Image  179G 
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Figure  4.2-14.  Thinned  Gradient  Direction  Display,  Image  1800 
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Figure  4.2-15.  Thinned  Gradient  Direction  Display,  Image  1804 
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for  Images  1788,  1792,  1976,  1800,  and  1804.  The  process  for  obtaining  edges 
from  the  thinned  gradient  data  Is  described  In  Appendix  A  of  the  first  Quarterly 
Report  in  the  section  on  the  Westlnghouse  AUTO-Q  System;  the  edges  derived  from 
Images  1784,  1788,  and  1792  are  shown  In  Figures  4.2-16  through  4.2-18.  Refer 
to  Appendix  A  for  a  description  of  the  registration  process,  the  results  of 
which  are  shown  In  Figure  4.2-19.  The  DELX  and  DELY  are  the  offsets,  rounded  to 
the  nearest  pixel,  between  the  present  window  and  the  proceeding  one  based  on 
the  registration  results.  The  Full  Window  represents  a  128x128  window 
containing  the  target  registered  against  another  128x128  window  containing  the 
target.  The  Target  Window  represents  a  60x50  window  containing  the  target 
registered  against  a  128x128  window  containing  the  target.  The  first  two  and 
the  fourth  result  differ  by  one  pixel;  the  third  result  Is  registered  exactly, 
and  the  last  result  differs  by  2.2  pixels. 

In  conclusion,  it  appears  that  on  the  whole,  the  notion  of  using  frame- to- 
frame  registration  as  a  means  of  tracking  close-in  targets  offers  sufficient 
accuracy  (one  pixel)  to  be  feasible  and  can  be  substantially  speeded  by  using 
only  a  small  window  about  the  target.  Such  an  approach  may  be  necessary  because 
of  difficulties  in  1)  using  correlation  procedures  in  the  presence  of  object 
contours,  and  2)  segmenting  as  one  object  a  target  which  contains  non-negliglbl 
interval  contrasts  and  edges.  Critical  aimpoint  selection  procedures,  in  this 
case,  would  either  depend  on  precise  handoff  and  continued  maintenance  of  the 
aimpoint  derived  by  long  range  methods  (with  accuracy  limited  by  resolution  at 
the  range  of  track  mode  transition)  or  on  new  methods  employing  the  subsets 
which  arc  yet  to  be  developed. 
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Figure  4.2-19.  Comparison  of  Offsets  (Pixels) 
for  Succeeding  Registrations 


4.2.3  Tracking  During  Transition 

The  purpose  of  this  section  Is  to  discuss  tracking  during  the  transition 
from  long  range  almpolnt  selection  and  homing  to  close-in  aimpolnt  selection 
and  homing.  In  Section  4.1,  we  presented  a  concept  and  examples  of  long  range 
aimpolnt  selection;  In  Section  4.2.2,  we  presented  a  concept  for  close-in 
segmentation  and  an  example.  Tere,  we  consider  the  transition  from  one  to  the 
other  or  "hand-over",  If  you  will.  There  are  two  parts  to  the  problem.  One 
question  Is  the  accuracy  of  handing  over  from  binary  correlation  tracking  to  edge 
tracking,  another  question  Is  the  accuracy  of  edge  tracking  Itself.  In  general, 
edge  tracking  accuracy,  which  Is  really  successive,  frame -to- frame  registration, 

Is  proportional  to  the  initial  offset  between  frames  and  inversely  proportional 
to  the  square  root  of  the  number  of  edges  used.  To  test  edge  tracking  accuracy  the 
following  procedure  is  employed. 

The  Westinghouse  lab  equipment,  at  present,  extracts  a  128x128  pixel  window 
from  a  video  tape.  Thus,  the  largest  window  for  the  successive  registration 
test  is  128x128  pixels.  Within  the  128x128  pixel  window  Is  the  30x30  pixel 
target.  Since  the  registration  accuracy  is  inversely  proportional  to  the  number  of 
edges  used,  successive  registrations  of  128x128  windows  can  be  more  accurate 
than  a  30x30  window  registered  against  the  following  128x128  window.  In  other 
words,  the  accuracy  of  registering  the  30x30  target  against  the  following 
128x128  window  can  be  evaluated  by  comparing  it  with  the  registration  of  the 
full  128x128  window,  containing  the  30x30  target,  against  the  following  128x128 
window.  Since  the  same  window  pairs  are  used  for  each  registration,  the  offset 
Is  the  same  for  both  registration^,  The  data  for  this  example  is  from  the  NV&E0L 
875  FUR  data  set  as  described  in  the  First  Quarterly  in  Section  2.2.5.  The 
video  tape  is  "Tape  #5  11/14/77",  Tape  Position  5280.  It  is  a  side  view  of  a 
tank,  moving  from  right  to  left  across  the  field  of  view.  To  verify  the 
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accuracy  of  the  edge  registrations  the  contents  of  the  track  window  are  registered 
against  the  128x128  subsequent  window.  This  result  Is  compared  against  a 
registration  of  the  entire  128x128  window  against  the  following  128x128  window. 

If  the  point  of  maximum  correlation  occurs  at  the  same  x,y  position  for  the  30x30 
vs.  128x128  as  the  128x128  vs.  128x128  for  the  same  successive  frames,  the 
accuracy  test  Is  successful.  Figure  4.2-20  shows  the  x,y  coordinates  for  the 
point  of  maximum  correlation  for  sevdt al  sets  of  windows  for  both  types  of 
registration,  l.e.  128x128  vs.  128x128  and  30x30  vs.  128x128.  An  examination  of 
Figure  4.2-20  shews  that  the  maximum  correlation  points  for  both  types  of 
registration  differ  by  0.5  pixels  or  less.  Hence,  the  30x30  pixel  vs.  128x128 
pixel  registration  offers  sufficient  accuracy.  We  shall  discuss  this  result  more 
in  the  conclusions  to  this  section,  but  we  want  to  develop  another  result  first. 
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Thus  far,  we  have  discussed  the  second  problem  associated  with  tracking  dur¬ 


ing  transition.  We  now  discuss  the  first  one;  namely,  the  accuracy  of  handing 
over  from  binary  correlation  to  edge  tracking.  Note,  that  in  Figure  4.2-20,  the 
target  movement  from  frame- to-frame  was  not  described.  We  merely  talked  in  term.', 
of  the  point  of  maximum  correlation  and  never  discussed  the  displacement  of  one 
image  relative  to  the  other  to  obtain  a  maximum  correlation  value.  In  comparing 
binary  correlation  tracking  against  edge  tracking  for  the  same,  successive  frames, 
this  displacement  is  used  to  make  the  comparison.  The  aimpoint  computations  and 
frame- to-frame  tracking  results  for  images  404,  408,  and  412  are  shown  in 
Figures  4.2-21,  4.2-22,  and  4.2-23.  Note  that  the  movement  of  the  track  window 
within  the  image  is  included  in  the  aimpoint  computations  also.  Thus, Ax  =  2, 

Ay  =  0  from  image  404  to  408  and  Ax  =  4,  Ay  =  1  from  images  408  to  412. 

The  Ax,  Ay  displacements  indicate  the  relative  displacement  of  the  second  track 
window,  for  image  408,  from  the  first,  image  404.  Since  the  track  window  size  is 
the  same.  Ax,  Ay  are  equivalent  to  the  relative  displacement  of  the  point  of  maximum 
correlation.  In  Figure  4.2-24,  we  show  the  relative  displacements  of  the  maximum 
correlation  points  for  both  sets  of  images.  Also  included  are  the  relative 
displacements  of  the  points  of  maximum  correlation  for  the  30x30  vs.  128x128 
and  128x128  vs.  128x128  edge  registration  approaches,  rounded  to  the  nearest  pixel. 

Note  that  the  error  in  displacement  between  the  binary  correlation  tracker 
and  the  30x30  vs.  128x128  edge  tracking  is 


y  (AXj  -  Ax2)2  +  (Ayx  -  Ayz)  —  /2  J 

in  both  cases;this  is  a  measure  of  the  accuracy  of  the  handover  process.  In 
the  binary  correlation  against  128x128  edge  tracking,  the  error  is  1.0  pixels  and 
1.4  pixels,  respectively.  By  the  standards  of  registration  for  large  windows 
(500x500  )  where  the  registration  accuracy  can  approach  0.25  pixels,  this  result 
is  not  impressive.  However,  the  1.4  pixel  error  in  placing  the  32x32  track  window 

is  not  very  serious  and  appears  to  b|  ^equate. 
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Figure  4.2-21 


Aimpoint  Computations,  Image  404 
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Figure  4.2-22.  Aimpoint  Computations,  Image  408 
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Figure  4.2-23.  Aimpoint  Computations,  Image  412 
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DISPLACEMENT  OF  MAXIMUM  CORRELATION  POSITIONS 
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figure  4.2-24.  Comparison  of  Correlation  Displacement 
for  Several  Registration  Approaches 

In  conclusion,  these  error  magnitudes  mean  that  the  approximate  target  size 
ar.d  position  from  a  previously  cued  or  tracked  window  can  be  used  to  extract  a 
window  of  gray  code  from  the  frame  store  (Section  1.0).  The  edges  (subsets)  can 
be  extracted  from  this  window  and  used  to  register  against  the  entire  image  of  the 
following  frame  with  satisfactory  accuracy.  Hence,  the  handover  to  close-in 
homing  and  aimpoint  selection  can  be  accomplished  because  the  aimpoint  can  be 
accurately  placed,  within  1.4  pixels,  on  the  following  image  also. 
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